This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of the 
original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 



BLACK BORDERS 

TEXT CUT OFF AT TOP, BOTTOM OR SIDES 
FADED TEXT 
ILLEGIBLE TEXT 
SKEWED/SLANTED IMAGES 
COLORED PHOTOS 

BLACK OR VERY BLACK AND WHITE DARK PHOTOS 
GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problems Mailbox. 



THIS PAGE BLANK (uspto) 



(19) 



Europaisches Patentamt 
Europ an Pat nt Qffice 
Offic europ 'en des br v ts 



(11) 



EP 0 966 138 A2 



(12) 



EUROPEAN PATENT APPLICATION 



(43) Date of publication: 

22.12.1999 Bulletin 1999/51 

(21) Application number: 99304858.6 

(22) Date of filing 21.06.1999 


(51) mtci .6; H04M 1/72, H04Q 7/32 


(84) Designated Contracting States: 


(72) 


Inventors: 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


• 


Emmott, Stephen J. 


MC NL PT SE 




London SW1 W 8QR (GB) 


Designated Extension States: 


• 


Johnson, Graham I. 


AL LT LV MK RO SI 




Tayport, Fife DD6 9AA (GB) 




• 


Woods, Sarah 


(30) Priority: 19.06.1998 GB 9813155 




London SE1 9JL (GB) 


14.09.1998 GB 9819935 








(74) 


Representative: Clean/, Fidelma et al 


(71) Applicant: NCR INTERNATIONAL INC. 




International IP Department 


Dayton, Ohio 45479 (US) 




NCR Limited 






206 Marylebone Road 






London NW1 6LY (GB) 



(54) A portable communication device and a method of generating E-mail messages 



CM 
< 

00 
CO 

CD 
CD 

o> 
o 

£L 
LJJ 



(57) A portable communication device (1 0) compris- 
es a housing (11) which accommodates a number of 
components enabling the user to effect two-way com- 
munications including data transfer and personal com- 
munications. The components include a selectively op- 
erable smart card sensor (18), a display device (12), a 
mobile electronic data communications facility to re- 
ceive and transmit data communications, and a data 
transaction processing means (20) in data communica- 
tion with the smart card sensor, the display device and 
the data communications facility Such a portable device 
( 1 0) includes a microphone ( 1 3). The processing means 
is programmed for speech recognition and receives sig- 
nals produced by the microphone. The processing 
mean, in response, produces text and the mobile data 
communications facility transmits the text to a remote 
site. The text may form part of an e-mail message sent 
by the device. 
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Description 

[0001] The present invention relates to a portable 
communication device and a method of using the device 
in generating e-mail messages. The communication de- $ 
vice comprises a housing which accommodates a 
number of components enabling the user to effect two- 
way communications including data transfer and per- 
sonal communications. 

[0002] The wallet or purse is the traditional and famil- 10 
iar means to hold cash and other everyday objects about 
the person. Other devices such as credit cards, smart 
cards and tokens have broadened the range of personal 
financial transactions so that a choice can be made to 
transact purchases and make other financial transac- is 
tions either with cash held in the wallet or purse or elec- 
tronically through retail point-of-sale terminals or auto- 
mated teller machines. An even wider range of transac- 
tions has become commonplace through the advent of 
telephone banking whereby telephone or personal com- 20 
puter instructions to the relevant institution can be com- 
municated for financial transfers and the purchase of 
services. 

[0003] The variety of means to manage money has 
thus expanded so that the individual user is faced with 25 
a mass of different, often technologically complex de- 
vices and interfaces for communication and transaction 
in different contexts such as within the home, on the 
move or at work. The user is also faced with an increas- 
ing diversity of information from advertisers, banks and 30 
retailers which may affect the management of financial 
affairs. 

[0004] It is an aim of the present invention to provide 
a portable communication device which provides the us- 
er with improved communications facilities. 35 
[0005] The invention consists in a portable device, 
characterised by a microphone, speech-recognition 
means for receiving signals produced by the micro- 
phone and, in response, producing text, and a transmit- 
ter for transmitting the text to a remote site. 40 
[0006] In one embodiment, the portable device com- 
prises a housing incorporating at least one selectively 
operable smart card sensor, a display device, a mobile 
electronic data communications facility to receive and 
transmit data communications, and a data transaction 45 
processing means in data communication with the smart 
card sensor, the display device and the data communi- 
cations facility. 

[0007] The selectively operable smart card sensor 
may incorporate a switch engageable by the user. The so 
switch is preferably located to be operable through the 
intermediary of pressure applied to flex a smart card 
held by the sensor. 

[0008] The invention also consists in a method of gen- 
erating e-mail messages, characterised by the steps of 55 
receiving speech in a portable device, converting the 
speech to text, displaying the text, accepting a signal 
from a user indicating that the text should be transmit- 
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ted, adding an e-mail address to the text to form an e- 
mail message, and transmitting the e-mail message to 
a communication network. 

[0009] In order that the present invention may be 
more readily understood, reference will now be made, 
by way of example, to the accompanying drawings in 
which:- 

Figure 1 shows a portable communication device 
incorporating the present invention, 
Figure 2 is a block diagram of an electronic network 
including a network site constituted by the device of 
Figure 1 , and 

Figure 3 shows a block circuit diagram of compo- 
nents accommodated within the communication de- 
vice of Figure 1 . 

[0010] Referring to Figure 1 of the accompanying 
drawings, there is shown a portable, hand-held commu- 
nication device 10 comprising an outer casing 11 . A liq- 
uid crystal display 12 is mounted on a front face ofthe 
casing 11. Above the display 12, as seen in Figure 1, 
are arranged a microphone/loudspeaker 1 3, a user rec- 
ognition device 14 and an antenna 1 5. Belowthe display 
12 are arranged vertical cursor control controls 16 and 
horizontal cursor controls 17 to control a cursor dis- 
played on the display device as will be explained. The 
device 10 also has a pair of smart card sensors 18, a 
paging control 1 9, and a transaction processor 20. Data 
communication ports 21 allow external data communi- 
cation to the data processor 20. The transaction proc- 
essor 20 and the ports 21 are shown diagrammatically 
in dotted lines in Figure 1 because they are disposed 
within the interior ol the casing 11 . 
[0011] Each of the smart card sensors 18 includes a 
receiving slot 22 to receive a smart card and hold the 
smart card in an operating position for data communi- 
cation with sensor contacts within the smart card sensor. 
An example of a smart card 23 useable with the sensors 
18 is shown alongside the device 10. The smart card is 
generally T-shaped and carries a semiconductor chip 24 
which has contacts for engagement with the smart card 
sensor contacts in the device 10. An operating switch 
25 is mounted above each sensor 18 to be overlaid by 
the cross-bar of the T-shaped smart card when in use. 
The switch 25 is operable in response to pressure ap- 
plied by a user of the device 10 to flex the smart card 
into engagement with the switch 25. The switch is then 
operated by the pressure applied through the interme- 
diary of the flexed smart card held by the sensor. The 
number of smart card sensors 18 is a matter of design 
choice. Although only two such sensors have been 
shown, there may be any convenient number other than 
two. 

[0012] The cross-bar of the T-shaped smart card 23 
is wider than the entry slot 22 of either smart card sensor 
18 The cross-bar therefore acts as an abutment to reg- 
ister the smart card 23 precisely in relation to the sensor 
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contacts within the smart card sensor 18 upon entry of 
the smart card into the slot 22. Whilst a T-shaped smart 
card is to be preferred, other shapes may be used to 
provide a suitable abutment to register the smart card 
in the sensor 18 and to overlay the switch 25. For ex- 5 
ample the cross-bar of the smart card may be replaced 
by a tongue ol circular or elliptical shape. 
[0013] Referring to Figure 3, the transaction proces- 
sor 20 is shown to incorporate a read-only memory 20a. 
The transaction processor is connected through a data to 
bus 30 to the liquid crystal display 12, the smart card 
sensors 18, a random access memory 31 , an electronic 
mobile communications facility 32 and the microphone 
1 3. The electronic mobile communications facility incor- 
porates the antenna 1 5. 15 
[0014] In Figure 2, the device 10 is shown in operation 
as one site of an electronic communications network. 
Other sites include a retail store 33 including a commu- 
nications centre 34 and a home building 35 including a 
personal computer 36. The communications network is 20 
shown diagrammatically to include a satellite 37 which 
provides a link to satellite dishes 38 provided on the 
buildings 33 and 35. It will be understood by those skilled 
in the art of electronic communications that the network 
is capable of transmitting data to be relayed over the 2 $ 
public switched networks with additional links to the in- 
ternet for e-mail communications. 
[0015] In operation, a user can operate the paging 
control 1 9 to gain access to the data communications 
network The recognition device 1 4 is a biometric device 30 
which responds to the requested access and operates 
by reference to an image of the iris of the authorized 
user. The authorized image is stored by the transaction 
processor, when an attempt is made to use the device 
10, a comparison is made between the stored image 35 
and the iris of the user attempting to use the device 10. 
If there is a match between the iris of the user and the 
stored image, the transaction processor 20 is enabled 
and a message informing the user of this is displayed 
on the display screen 1 2. If there is no match, the trans- 40 
action processor 20 is shut down. 
[001 6] It will be apparent to those skilled in the art that 
the biometric recognition device 14 may take a form oth- 
er than an iris recognition device. One such alternative 
form is a biometric recognition device in which recogni- 45 
tion is made of the fingerprint of the authorized user. 
[0017] Upon recognition of the user, the transaction 
processor 20 is programmed by means of programs 
stored in the ROM 20a to display to the user a menu of 
options on the screen 12. The options enable mobile $o 
electronic banking and communication; electronic com- 
merce, personal communication, data transfer and com- 
puting operations as will be explained. 
[0018] In a first option, the user may select a banking 
operation which involves the use of a smart card 23 in- 55 
serted in one of the smart card readers 18. The smart 
card reader 18 is switched on by pressure on the smart 
card 23 which flexes into engagement with the switch 



25. The smart card communicates via the data bus 30 
with the transaction processor 20 to signal the selection 
of the chosen smart card 23 and to transfer data from 
the smart card to the RAM 31 under the control of the 
transaction processor 20. The data in the RAM 31 in- 
cludes encrypted information which is accessed by the 
transaction processor 20 and subject to decryption by 
means of a decryption program stored in the ROM 20a. 
The decrypted information may include financial infor- 
mation such as the balance of currency stored in the 
smart card. The financial information is displayed to the 
user on the screen 1 2 so that the user may be informed 
of the balance stored on the smart card. 
[0019] In the event that the user chooses to increase 
the balance of currency stored on the smart card 23, the 
user may opt to select this option from the display on 
the screen 12. The option is selected by moving a 
screen cursor to the location where that option is dis- 
played under the control of the cursor controls 16 and 
17. The selection of the option is communicated via the 
data bus 30 to the transaction processor 20 which is pro- 
grammed to send data to activate the mobile communi- 
cations facility 32. The communications facility 32 is ac- 
tivated to communicate a message over the network il- 
lustrated in Figure 2. The message may be addressed 
to a bank to dispense currency of a value selected from 
the screen 12 by the user. The bank dispenses the re- 
quested currency value by sending a return message to 
the facility 32 for entry into the RAM 31 under the control 
of the transaction processor 20. The value of any dis- 
pensed currency is deducted from the balance of an ac- 
count held by the user. The dispensed currency is com- 
municated from the RAM 31 to the smart card reader 18 
via the data bus 30 to be entered into the smart card 23. 
[0020] From the above explanation, it will be seen that 
the device 10 can be used as a digital wallet in which 
the currency value stored in one or more of the smart 
cards 23 can be increased because the display device 
12 is user operable to communicate financial transac- 
tion instructions to the transaction processing means 
20, and the data transaction processing means 20 is 
programmed to respond to the user instructions to effect 
financial transfers between the smart card reader 18 
and the data communications facility 32. 
[0021] The cash stored electronically in the smart 
cards 23 can be used to make purchases electronically. 
In this case, the user may choose an option from the 
screen 12 to make a purchase using a card 23 enlered 
into a selected card reader 18. The different card read- 
ers 18 may hold smart cards which correspond to indi- 
vidual retailers. For example one smart card reader 18 
may hold a smart card 23 individual to a food store and 
another may hold a smart card 23 individual to an auto- 
mobile fuel station. The choice of smart card reader is 
made by the user by pressing a smart card to activate 
the corresponding switch 25. The display screen 1 2 and 
cursor controls 16 and 17 enable the user to enter the 
data relevant to the purchase. The purchase is commu- 
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nicated electronically by way of the communications fa- 
cility 32 over the network to the retailer or service pro- 
vider from whom the purchase is being made. A return 
message from the retailer or service provider acknowl- 
edging the purchase is entered into the RAM 31 and the 
transaction processor 20 responds to this return mes- 
sage by sending data via the bus 30 to the smart card 
reader 1 8 to deduct the purchase amount from the smart 
card 23 in the reader 18. 

[0022] The ROM 20a stores an identity code or call 
sign which is individual to the device 10 and which dis- 
tinguishes it from other such devices. In the communi- 
cations network shown in Figure 2 ; the retail store 33 
has a communications centre 34 which also stores the 
identity code or call sign for a multiplicity of portable 
communication devices each as constituted by the de- 
vice 10 of Figure 1 . The communications centre 34 has 
the capability of transmitting call signs for the multiplicity 
of devices 10 The call signs are transmitted continually 
by the retail store 33 to be received over an area in prox- 
imity to the store 33. As a user carrying one of the de- 
vices 10 nears the retail store, the device 10 picks up 
the call signs through the antenna 15. The call signs 
from the retail store include an identifier to indicate that 
the source of the call signs is the retail store. 
[0023] The transaction processor 20 is programmed 
to recognize an incoming signal as a call sign and is also 
programmed to compare the incoming call sign with the 
call sign in the ROM 20a when the incoming call sign 
matches that stored in the ROM 20a, the transaction 
processor deciphers the identifier to register that the call 
signs emanated from the retail store and places an an- 
swering message on the bus 30 which is transmitted by 
the communications facility 32 as an outgoing message 
to be received by the communications centre 34. The 
answering message advises the communications cen- 
tre that the device 10 is in the vicinity of the retail store 
33. The communications centre 34 responds tothe mes- 
sage from the device 10 by sending personalized data 
to the device 10 preceded by the call sign for the device. 
The personalized data may include a welcome mes- 
sage, updating information about purchases available 
at a discount price and credit facilities available to the 
user. The user is informed through the display 12 that 
communication has been established with the particular 
retail store identified by the call sign and that a purchase 
may be made from the store using the smart card 23 
corresponding to that store. 

[0024] The microphone 1 3 is provided to widen the 
communication capability of the device 10. The micro- 
phone incorporates an analog to digital conversion cir- 
cuit so as to enable digital information to pass via the 
data bus 30 to the transaction processor 20. The trans- 
action processor 20 has a speech recognition program 
capable of converting the microphone input into a text 
output for display on the screen 1 2 and for communica- 
tion to the communications facility 32. The user may se- 
lect an option from the screen 1 2 to compose a message 



to be sent via the communications facility 32. The mes- 
sage may, for example consist of a paging message or 
may be an e-mail message. The selection of the mes- 
sage option through the screen 12 is communicated to 
s the transaction processor 20 via the data bus 30. In re- 
sponse, the transaction processor requests the user via 
the screen 12 to enter the message through the micro- 
phone 13. The transaction processor 20 receives the 
digital form of the message via the data bus 30 and is 
10 programmed to store the message in the RAM 31 . The 
transaction processor converts the digital data in the 
RAM 31 to text data which is supplied by way of the bus 
30 to be displayed on the screen 1 2. The user is request- 
ed to confirm or cancel the displayed message. If the 
is message is confirmed, the transaction processor 20 
controls the communication facility 32 to receive the text 
data from the bus 30 and to transmit the message over 
the appropriate mobile communications network. 
[0025] In the communications network shown in Fig- 
20 Lire 2, the home building 35 includes a personal compu- 
ter 36 with a home communications centre. The home 
communications centre is loaded with the call sign of a 
user device 10 and is adapted to transmit the call sign 
continually in an area within the vicinity of the home 
2S building. The call sign transmitted from the home com- 
munications centre includes an identifier to indicate that 
the source of the call sign is the home communications 
centre. Once the user has reached the proximity of the 
home building, the device 10 matches the call sign 
30 transmitted from the home building to the call sign stored 
in the ROM 20a in the manner already described above. 
The response of the transaction processor 20 is to rec- 
ognize that the call sign is form the home communica- 
tions centre and to formulate an answer message which 
35 interrogates the personal computer 36. The personal 
computer is programmed to respond with a transmission 
of personal information tothe device 10. Such informa- 
tion may include a welcome message, recorded tele- 
phone messages and paging information. The personal 
40 computer 36 is linked to a public switched network for 
the purpose of taking and recording messages received 
while the user is away from the home building 35. 
[0026] Request messages can also be transmitted 
from the device 10 to request information from informa- 
45 tion servers to be displayed on the screen 12 or to be 
downloaded onto a smart card 19. The downloaded in- 
formation may, for example, be of sporting results, finan- 
cial share information, music or any other material which 
can conveniently be transmitted and received for stor- 
50 age in a smart card. Intelligent agent programs may be 
stored by the transaction processor 20 or accessed by 
a request message transmitted from the device 10 by 
the user. Such intelligent agent programs may be used 
to search for material to be transmitted back or may be 
55 used to filter material which is transmitted back. 
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Claims 

1. A portable device (10), characterised by 

a) a microphone (13), $ 

b) speech-recognition means (20) for receiving 
signals produced by the microphone and, in re- 
sponse, producing text, and 

c) a transmitter (32) for transmitting the text to 

a remote site. io 

2. A portable device according to claim 1 , character- 
ised by display means (12) for displaying the text, 
and means responsive to a predetermined signal 
from a user to transmit data representing the text to i$ 
the remote site. 

3. A device according to claim 1 or 2, characterised in 
that the text is transmitted via a wireless communi- 
cation system. 20 

4. A method of generating e-mail messages, charac- 
terised by the steps of: 

a) receiving speech in a portable device (10), 2s 

b) converting the speech to text, 

c) displaying the text 

d) accepting a signal from a user indicating that 
the text should be transmitted, 

e) adding an e-mail address to the text, to form 30 
an e-mail message, and 

f) transmitting the e-mail message to a commu- 
nication network. 

5. A method according to claim 4, characterised in that 35 
step (f) comprises transmitting the e-mail message, 

by wireless transmission, tothe communication net- 
work. 
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FIG. 2 
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(54) A portable communication device and a method of generating E-mail messages 

(57) A portable communication device (1 0) compris- 
es a housing (11) which accommodates a number of y 
components enabling the user to effect two-way com- 
munications including data transfer and personal com- 
munications. The components include a selectively op- 
erable smart card sensor (18), a display device (12), a 
mobile electronic data communications facility to re- 
ceive and transmit data communications, and a data 
transaction processing means (20) in data communica- 
tion with the smart card sensor, the display device and 12- 
the data communications facility. Such a portable device 
(10) includes a microphone (13) . The processing means 
is programmed for speech recognition and receives sig- 
nals produced by the microphone. The processing 
mean, in response, produces text and the mobile data 
communications facility transmits the text to a remote PIG* 1 S 

site. The text may form part of an e-mail message sent 
by the device. 
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